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training materials in a variety of ways which provide continuing training benefits. During <^-^m^P«»^*' 5°^^^^^^ 
workVtetion station direct each smdcnt workstation to retrieve the desired data from the storage medium and display it on the student s screen. 
S^ss^ aud^rco^^ of the instructor's commentary and student comments, command data and screen interaction mformatio™ 
Summed ove; ordinary llephone lines. Each smdent's wortstaUon is able to display the fu 1 mummedm ^^^^^^^^^^ 
full-moUon video, realtime audio, photos, graphics, text and real-time annotations and commentary from the instructor and other students, 
by combining the locally-stored multimedia presentation and the interactive, real-time data. 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States paity to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


AlbsnU 


BS 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


Fl 


Finland 


LT 


Uthoanta 


SK 


Slovakia 


AT 


Austria 


FR 


Prance 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australb 


GA 


Gabon 


LV 


Latvia 


SZ 


Swautand 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovtna 


GE 


Georgia 


MD 


Republic of Moldova 


TC 


Togo 


BB 


Bvfoados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


m 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


baly 


MX 


Mexico 


VZ 


Uzbekistan 


CF 


Centra] African Repubbc 


JP 




NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KB 


Kenya 


NL 


Netherlaiub 


yu 


Yugoslavia 


CH 


S^¥itzerlBnd 


KG 


Kyrgyxslan 


NO 


Norway 


zw 


Zimbabwe 


a 


Cfitc d'lvotre 


KP 


Democralic I^ople's 


NZ 


New Zealand 






CM 


Canctoon 




Republic of Korea 


FL 


Poland 






CN 


China 


KR 


Republic of Koira 


FT 


Portugal 






CU 


Cuba 


KZ 


Kazakftan 


RO 


Romania 






CZ 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federal ion 






DE 


Germany 


U 


LBcfatenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapofc 







wo 98/03953 PCT/CA97/00526 . 

METHOD OF INTERACTIVE COMPUTER BASED INSTRUCTION 

This invention relates to a method of combining interactive instruction over a 
computer network with distributed course materials for the provision of cost-effective 
computer-based training to a geographically dispersed group of students. 

Conventional classroom training has become prohibitively expensive for many 
geographically dispersed organizations, because travel and living expenses can 
absorb up to 70 percent of the training budget. As a result, many organizations 
have attempted to use cun-ent computer and communications technology to reduce 
training costs. There are two commonly-used training methods. 

The first attempts to duplicate a classroom setting for a geographically dispersed 
group of students. An instructor at one location Is connected to one or more groups 
of students at remote locations using audio or video teleconferencing facilities, which 
are widely available from local telephone companies and other service providers. 
This method of instruction has the advantage of providing live two-way 
communication among geographically remote participants. However, these benefits 
come at a relatively high cost. 

Each of the participants must be at a location which has the necessary 
teleconferencing equipment. This may involve travel, if the participant's normal 
wori<place lacks the necessary facilities. The equipment is expensive to acquire and 
maintain. The participants must also be linked by high-speed communications lines 
(ISDN. T1 or the equivalent) in order to transmit the high volume of data needed for 



wo 98/03953 



PCT/CA97/00526 



effective communication. The charges for these communications lines are quite 
high, relative to ordinary telephone lines. As a result, this method of instruction is 
prohibitively expensive for many organizations. 

The second method of computer-based training adopts many of the traditional 
methods of correspondence courses and other distance learning techniques, using 
computer technology to enhance the effectiveness of the training. Training materials 
are physically distributed on computer-readable media such as CD-ROMs. Each 
CD-ROM can typically hold all of the data required for a complete training course, 
including memory-intensive data like full-motion video. However, each student must 
10 work independently to learn the material. There is little or no opportunity to interact 
with an instructor or other students. This method of instruction has significant cost 
advantages over on-line training, but is not as effective for delivering consistent, 
timely training. 

Various methods have been attempted to reduce the cost of on-line training. 
Typically, these involve decreasing the amount of information transmitted between 
the instructor and the students. However, each of these methods results in a 
significant decrease in the effectiveness of the training, because they interfere with 
essential communication t>etween the students and the instructor. 

The problem which the present invention seeks to address is to combine the 
20 effectiveness and immediacy of on-line training with the cost advantages of distance 
teaming, in order to provide an inexpensive and effective method of interactive 
computer-based instruction. 
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According to the present invention, a method is disclosed for combining the on-line 
transmission of audio or video instruction and related data with distributed training 
software and data to reduce the cost and increase the effectiveness of computer 
based instruction. The present invention also discloses methods for providing 
immediate feedback from the students to the instructor regarding the content and 
presentation of the training materials, in order to permit the instructor to adapt the 
material to the specific audience for each session. The present invention also 
discloses methods for enabling each student to record and replay all or part of the 
training session and to re-use the training materials in a variety of ways which 
10 provide continuing training benefits. 

This invention has the advantage that it requires only a standard personal computer, 
equipped with a CD-ROM drive and multimedia hardware and software, connected 
to an ordinary telephone line, rather than dedicated teleconferencing facilities. In 
this way, each student can participate in the training session at their nomaal 
woricplace (or at home, if desired). 

In one aspect of this invention, a method is provided for combining physically- 
delivered time-independent infomiation and electronically-delivered time-sensitive 
information in which the time independent infonmation is delivered to the 
geographically separated locations prior to the time-sensitive information, the time- 
20 sensitive infomriation is simultaneously delivered from a single location to one or 
more individuals at geographically separated locations, and the said time-sensitive 
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information is combined in an interactive manner with the said time-independent 
information at the said geographically separated locations. 

In another aspect of this invention, a computer program is used to combine 
physically-delivered time-independent Information and electronically-delivered time- 
sensitive infonmation, where the time independent information is delivered to the 
geographically separated locations prior to the time-sensitive information, the time- 
sensitive infonnation is simultaneously delivered from a single location to one or 
more individuals at geographically separated locations, and the time-sensitive 
information is combined in an interactive manner with the time-independent 
10 infomnation at the geographically separated locations. 

In another aspect of this invention, a method is provided for delivering physically- 
delivered time-independent information and electronically-delivered time-sensitive 
infonnation, the time-independent information being adapted to combine with 
electronically-delivered time-sensitive infonnation. comprising the steps of delivering 
the time independent information to geographically separated locations prior to the 
time-sensitive information, simultaneously delivering the time sensitive information 
from a single location to one or more individuals at geographically separated 
locations, and combining the said time-sensitive information with the said time- 
independent infomnation in an interactive manner at the said geographically 
20 separated locations. 

In another aspect of this invention, a method is provided for delivering interactive 
instruction relating to time-independent infonnation on computers at geographically 
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separated locations where a computer at a single location is linked with computers 
at one or more geographically separated locations, time-sensitive information is 
delivered from the computer at the said single location, the said time-sensitive 
information is used with the time-independent infomnation at the geographically 
separated locations by the computers at the said geographically separated 
locations, data generated at the said geographically separated locations is received 
and analyzed at the said single location, and a response is delivered to the said 
geographically separated locations. 
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The following description and attached figures show the prefen-ed embodiment of 
this invention. 

The invention provides a method of interactive computer-based training in a "hybrid" 
mode, with multimedia content stored on a CD-ROM, "ZIP" drive or other suitable 
storage medium and delivered to the remote student locations. 

During on-line sessions, commands from the instructor station direct each student 
station to retrieve the desired data from the storage medium and display it on the 
student's screen. Compressed audio, consisting of the instructor's commentary and 
student comments, command data and screen interaction information are 
10 transmitted over a communication link in real time throughout the on-line session. 
Unlike other video conferencing or distance learning systems, tiie interactive data 
can be transmitted over ordinary telephone lines which are available in virtually 
every home and workplace; high-speed, dedicated voice or data communications 
lines are not required, but may be used. 

Each student's workstation is able to display the full multimedia training session, 
consisting of full-motion video, real-time audio, photos, graphics, text and real-time 
annotations and commentary from the instructor and other students, by combining 
the locally-stored multimedia presentation and the interactive, real-time data. 

Each of the individual on-line and locally stored components of the training session 
20 are combined on the computer screen display of each participant. The display 
includes a course control window, a presentation v\nndow, a notes window and a 
status window. The display also includes a series of context-sensitive control icons. 

6 
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Figure 1 shows the overall process flow for the preferred embodiment of this method 
of computer-based instruction. Figure 1(a) shows the course design module, which 
enables the instructor to design the instruction session, prepare questions and 
answers, and design presentation slides and overlays. Figures 1(b). 1(c) and 1(d) 
show the components of the course presentation process. 

Figures 2 through 14 show details of the screen displays used in the prefen-ed 
embodiment of this invention. 

Figure 2 shows the instructor station display and controls. The display comprises a 
menu bar 1 , a course control window 3 with drop-down menu list 4, a series of 
10 interaction icons 6. a presentation window 8 with context-specific command icons 9, 
a notes window 11, a class status window 13, class feedback icons 15, on-line 
status indicator 1 9. and current time display 24. 

Figure 3 shows the student station displays and controls. The student display 
comprises a menu bar 1, a course control window 3 with drop-down menu list 4, a 
series of interaction icons 6. a presentation window 8 with context-specific 
command icons 9, a notes window 11. feedback icons 15. on-line status indicator 
19, and cun-ent time display 20. 

Each student's display also includes a number of commands, which the student may 
activate by using a keyboard, mouse or other input device to select a command from 
20 the menu bar 1 or to point to the applicable icon. For example, these commands 
may include a signal to the instructor that the student wishes to ask a question or 
make a comn>ent, that the student does not understand a particular aspect of the 

7 



W0 98rt)3953 



PCT/CA97/00526 ^ 



presentation or that the student feels that the presentation is moving too slowly or 
too quickly. These commands may be initiated by selecting one of the feedback 
icons 15. 

An audiographics conferencing capability allows full application sharing between the 
instructor and students. The instructor controls the content of the session, but may 
use the interaction icons 6 to permit any student to make comments on the 
presentation, which comments are transmitted to each of the other participants. 
Student comments may be made verbally, using the two-way audio facilities, or in 
writing, through typed or handwritten comments which appear in the presentation 
10 window 8 or the notes window 1 1 of each participant's screen. The instructor may 
also choose to communicate with each student individually, to provide additional 
infomiation or guidance during on-line assignments. Interactions between the 
instnjctor and an individual student may be kept private from other students or may 
be shared with the rest of the class, at the option of the instructor or the student, 
through the use if the interaction icons 6. 

Figures 4, 5 and 6 show examples of the audio-visual and graphical information 
which may be selected from the course control window 3 and displayed in the 
presentation window 8. The instructor's window includes command icons 22 to 
control the presentation of video and audio files. Graphical annotation 24, overlay 
20 33 and whiteboard 26 features permit the instructor or students to add more detailed 
infonnation to a presentation. The presentation window 8 is scaleable to allow 
several features to be used simultaneously. When the whiteboard 26 function is 

8 
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selected, the slide which was previously displayed is reduced in size and remains on 
the screen as a reference 28. Either the instructor or the student may control the 
size and positioning of the reference slide 28. 

Multiple levels of overlays may be used to annotate graphics or display context- 
sensitive labels 30. as shown in Figure 7. or to demonstrate a multi-step process, 
overlay or peel away segments to show different levels of an object or steps in a 
process 33, as shown in Figures 8, 12, 13 and 14. Overlays 33 may be added or 
removed using a context-sensitive control window 36. Overlays 33 may also be 
used to time the delivery of an audio file to provide additional information or add 
10 emphasis. The whiteboard 26 feature may be used to highlight or explain 
information shown in the presentation window. Text may be displayed in the 
presentation window 8 and particular words or phrases may be emphasized using 
overlays of different colours and thickness 31 . The emphasis may be saved by the 
instructor and included in subsequent sessions, or by an individual student in a 
personal study file. 

The instructor may test student comprehension by asking periodic questions during 
the training session. Questions appear in the presentation window 8 and may be in 
the fomi of multiple choice, drag-and-drop matching, fill in the blanks, or true/felse. 
Figure 9 shows an example of the use of labels 30 which are filled in by the student. 
20 Figure 10 shows the use of true or false questions, which the student answers by 
selecting the appropriate response icon 32 displayed in the presentation window 8. 
Similar icons may be used for multiple choice questions. Questions may be 
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displayed individually, in predetermined or random order, or may be displayed 
together as a test. During a test, the instructor may enable or disable specific 
elements of the database to provide either "open-book** testing, in which the student 
may search specified material for required information, or "closed-book" testing, in 
which the student must answer the questions from memory. 

The instructor may use the status window 13 to monitor the progress of an individual 
student or the class as a whole. In Figure 9 the status window 13 has been set to 
show the percentage of class members who have responded to each question. 
Student responses may be compiled and displayed on the instructor's screen 
immediately. They may also be saved for further analysis by the instructor. This 
feature provides immediate feedback to the instructor, who can adjust the 
presentation to provide more detailed Information or repeat key points, as required. 
At the instructor's option, class and individual performance may be displayed to all 
students, or individual results may be shown to each student. 

The class status window 13 and feedback icons 15 allow the instructor to monitor 
the status of the class. Tabs 14 at the top of the status window 1 3 are used to 
select the information to be displayed. It is prefenred that bar graph displays are 
used to visually convey class status information to the instructor. The "confusion*" 
and "pace" displays allow the instructor to monitor the effectiveness of the 
presentation. An audio or video alamn. with user-adjustable parameters, may be 
provided to alert the instructor when the class status measures reach a specified 
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threshold. For example, the alarm could be set to be triggered when more than 33 
percent of the class members indicate the pace is too slow or too fast. 

The instructor may obtain more detailed information about the feedback provided by 
individual students by selecting the student listing 38 from the drop down menu 4 of 
the course control window 3. The specific infonnation displayed in the student listing 
38 may be varied by selecting one of the class status icons 39, as shown in Figures 
12, 13 and 14. 

The instructor may use the computer keyboard to make presentation notes, which 
are displayed in the notes window 11 on the instructor's screen. Each student may 
10 use the computer keyboard to make private notes and comments which are 

displayed only in the notes window 1 1 on the student's screen and which are saved 
for later reference. 

Annotations 24 may be made directly on the information in the presentation window 
8, using a touch-sensitive display screen or a graphical tablet and a pointing device 
adapted for that purpose. Alternatively, annotations 24 may be made using a 
pointing device such as a mouse. Annotations 24 may be made privately by either 
the instructor or the students or may be displayed to the entire class. 

All or part of a training session may be recorded for later review or distribution by 
either the instructor or the student. The session may be recorded by saving on a 
20 computer hard drive or other suitable storage media at the student's location the on- 
line data and the instructions for combining that data with the previously distributed 
pre-recorded data. Using the command menu 1. each student station can 
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automatically recx)rd the entire session, including audio components, presentation 
window commands and real-time annotations, class questions and instructor 
responses, and any other interactive elements of the session. The student can set 
his or her workstation in advance to record the session if the student is not present 
at the scheduled training time. The student can replay the recorded training session 
at any convenient time or times. 

Alternatively, the training session may be recorded at the instructor's location and 
the recorded session may be distributed to other members of the organization who 
may not have access to communication facilities or are othenA/ise unable to 
10 participate in the on-line sessions. These distributed training sessions may be used 
as stand-alone, self-paced training modules. The student may interact with the 
recorded session in the same manner as an on-line session. 

Students may also recond specific parts of a training session. This feature may be 
used if the student does not fully understand a particular part of the presentation, but 
does not wish to stop the presentation to ask a question or request clarification. It 
may also be used if the student wishes to record a personal note or comment or to 
record a comment or annotation made by the instructor or another student. 

When recording all or part of a training session, the instructor or the student may 
assign one or more keywords to the training session or to specific portions of the 
20 session. This allows information associated with specific keywords to be saved and 
indexed in one or more databases, to be retrieved at a later time, regardless of 
where the material is stored. This feature allows specific information to be retrieved 
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without the necessity of creating separate files to store and retrieve specific audio, 
video or text data. Students may "pause" the on-line presentation, while continuing 
to record the session, in order to attend to other related or unrelated tasks during the 
training session. The student may disconnect from the session at any time. On-line 
status icons 19 on the instructor's screen shows the number of students who have 
paused the presentation and the numl>er of students who have disconnected from 
the session. 

One of the advantages of this Invention is that it uses widely-available personal 
computers and computer programs. In its prefeaed embodiment, this method uses 
10 (i) an instnjctor station consisting of a lOOmHz or faster Pentium computer. 

equipped with a CD-ROM drive, sound card, graphics tablet, audio headset and 28K 
modem; and (ii) student stations with a 66mHz or faster 486 class personal 
computer, equipped with a CD-ROM drive, sound card, graphics tablet, audio 
headset (or speakers and microphone) and 14K modem. In its prefen^ed 
embodiment, each of the computers uses the Microsoft "Windows 95" operating 
system. The software used to implement the method uses the TCP/IP 
communications protocol. It will woric over standard telephone lines; it will also vfork 
over local area networks (LANs), wide area networi^s (WANs). ISDN telephone lines 
and the Intemet 
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Claims 

I claim: 

1 . A method of combining physically-delivered time-independent information and 
electronically-delivered time-sensitive information in which: 

a) the time independent infbmnation is delivered to geographically 
separated locations prior to the time-sensitive infonmation; 

b) the time-sensitive infonnation is simultaneously delivered from a single 
location to one or more individuals at the said geographically 
separated locations; and 

c) the said time-sensitive Information is combined in an interactive 
manner with the said time-independent infonnation at the said 
geographically separated locations. 

2. A method, as claimed in claim 1 , in which the combination of the said 
infonnation is controlled by a person at the location from which the 
electronically-delivered information is sent. 

3. A method, as claimed in claim 1 , in which the combination of the said 
information is controlled interactively by one or more persons at the 
geographically separated locations. 

4. A method, as claimed in claim 1 . In which the infomnation to be combined 
comprises one or more of the following types of electronic data: 



14 



wo 98/03953 



PCT/CA97/00526 



a) live or pre-recorded audio; 

b) live or pre-recorded video; 

c) still photographs or drawings; 

d) animated graphics; 

e) alpha-numeric text; and 

f) hand-written annotations. 

5. A method, as claimed in claim 4, in which the data elements are 

simultaneously presented in one or more graphical "windows" which may be 
independently configured by each person receiving the infomiation. 

10 6. A method, as claimed in claim 2, in which the person controlling the 

combination of the information is able to temporarily transfer control to a 
person at one of the geographically remote locations. 

7. A method, as claimed in claim 2. in which the person controlling the 
combination of the information is able to alter the manner in which the 
information is combined in response to data inputs from the persons at the 
geographically remote locations. 

8. A method, as claimed in claim 7, in which the data inputs comprise one or 
more of the following: 

a) individual and collective comprehension levels; 

15 
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b) individual and group feedback on the speed of delivery of the 
infonnation; 

c) individual requests for further information; and 

d) individual requests for a transfer of control over the combination of the 
information. 

9. A method, as claimed in claim 1, in which the combination of infonnation may 
be recorded in whole or in part by the person controlling the combination or by 
any individual at one or more of the said geographically separated locations, 
by saving the data elements in the permanent memory of a personal 
computer, and the saved infonmation may be retrieved, reviewed, altered and 
re-saved at a later time. 

1 0, A system for combining physically-delivered time-independent information 
and electronically-delivered time-sensitive infonnation in which: 

a) the time independent infonnation is delivered to the geographically 
separated locations prior to the time-sensitive infonnation; 

b) the time-sensitive information is simultaneously delivered from a single 
location to one or more individuals at geographically separated 
locations; and 

c) the said time-sensitive infonnation is combined in an interactive 
manner with the said time-independent information at the said 
geographically separated locations. 

16 
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11. A method of providing physically-delivered time-independent information and 
electronically-delivered time-sensitive infonnation, the time-independent 
information being adapted to combine with electronically-delivered time- 
sensitive infomnation. comprising the steps of: 

a) delivering the time independent infomnation to geographically 
separated locations prior to the time-sensitive infomriation; 

b) simultaneously delivering the time sensitive infomiation from a single 
location to one or more individuals at geographically separated 
locations; and 

c) combining the said time-sensitive infomnation with the said time- 
independent infomiation in an interactive manner at the said 
geographically separated locations. 

12. A method, as claimed in claim 1 1, in which the combination of the said 
infomiation is controlled by a person at the location from which the 
electronically-delivered infomiation is sent. 

13. A method, as claimed in claim 1 1, in which the combination of the said 
infomiation is controlled interactively by one or more persons at the 
geographically separated locations. 

14. A method of providing interactive instruction relating to time-independent 
information on computers at geographically separated locations, comprising: 

17 
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a) linking a computer at one location with computers at one or more 
geographically separated locations; 

b) providing time-sensitive information from the computer at one location 
to computers at geographically separated locations; 

c) combining the time-independent infomiation with the time-sensitive 
infomiation at the geographically separated locations by the use of 
computers at those locations; and 

d) receiving from the geographically separated locations data generated 
at those locations, analyzing that data at the single location and 

10 responding to it. 
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